(19) 



J) 



(12) 



(43) Date of publication: 

05.01.2000 Bulletin 2000/01 



Europdisches Patentamt 
European Patent Office 
Off Ice europ^en des brevets (11) EP 0 969 380 A2 

EUROPEAN PATENT APPLICATION 

(51) intCl/: G06F 12/08, G06F 12/12 



(21) Application number: 99117731.2 

(22) Date of filing: 1 0.06.1 991 



(84) Designated Contracting States: 
DE FR GB 

(30) Priority: 11.06.1990 US 537466 
23.08.1 990 US 572045 

(62) Document number(s) of the earlier application(s) in 
accordance with Art. 76 EPC: 
91911776.2/0 533 805 

(71) /\pplicant: CRAY RESEARCH, INC. 
Eagan, Minnesota 55121 (US) 

(72) Inventors: 

• Wengelski, Diane M. 
Eau Claire, Wl 54701 (US) 



• Gaertner, Gregory G. 



Eau Claire, Wl 5470t^(^gl Abjag^J^ 

tTlauottermin 

(74) Representative: r 

Tothill, John Paul □^g ^ 2 2. NOV. 200 4 



Frank B. Dehn &C<», 
179 Queen Victoria 



London EC4V 4EL gpSt^ 



Stfeot Or. Peter Riebling j 



Remarks: 

This application was filed on 08 - 09 - 1999 as a 
divisional application to the application mentioned 
under INID code 62. 



(54) Method for efficient non-virtual main memory management 



CM 

< 

O 
CO 
CO 

a> 

CO 
O) 



a. 

UJ 



(57) The present invention provides a parallel mem- 
ory scheduler (1 120) for racecution on a high speed par- 
allel multiprocessor architecture (10). The operating 
system software provides intelligence and efficiency in 
swapping out process images to facilitate swapping in 
another process. The splitting and coalescing of data 
segments are used to fit segments into current free 
memory (50) even though a single contiguous space of 
sufficient size does not exist. Mapping these splits 
trough data control register sets (80) retains the user's 
contiguous view of the address space. The existence of 
dual images (14, 70) and partial swapping allows effi- 
cient, high speed swapping. Candidates for swap (150. 
160, 170) our are chosen in an intelligent fashion, 
selecting only those candidates which wilt most effi- 
ciently allow the swapin of another process. 
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Description 
TECHNICAL HELD 

5 [0001] The invention relates In general to operating system software for computer processing systems. More partic- 
ularly the present invention relates to methods for managing main memory for a non-virtual memory computer system. 

BACKGROUND ART 

10 [0002] Present day computer systems normally have an operating system, usually software interfacing with hardware, 
which functions to perform operations essential to the successful running of the computer system. The operating sys- 
tem for computer systems of the type Incorporating the present invention have a storage management system which 
consists of complex software and hardware mechanisms. Computer systems of this type can perform multiprogram- 
ming and can include multiple tightly coupled parallel processors sharing a common main storage or memory. Because 

15 of this, the storage management system, for the successful operation of the computer system, must ensure that the 
common main storage is available for use without undue delay by the multiple programs and processors. One technique 
used by the storage management system to accomplish this is process or program swapping. When more programs or 
processes are in various states of execution than can be stored in main storage, the storage management system trans- 
fers one or more processes to a secondary storage device, called a swap device, such as disk storage or other type of 

20 mass storage, i.e. swapping out, and an executable process can be transferred from the swap device into main storage 
by the storage management system, i.e. swapping in. 

[0003] Also, some operating systems have a storage management system which can do demand paging to facilitate 
multiprogramming. In such computer systems, the entire process or program does not have to reside in main storage 
to execute. The storage management system loads pages of a process on demand at the time the process references 
25 the required pages. 

[0004] The present invention is incorporated in a computer system that does not have demand paging. The entire 
process to be executed must reside in main storage and remain therein until it becomes Ineligible to execute. Therefore, 
while the storage management system of some computer systems can not perform demand paging to facilitate multi- 
programming or the use of highly parallel multiprocessors sharing a common main storage, they can use process swap- 

30 ping. Same computer systems using swapping, such as Unix® System V. select swapout candidates according to their 
priority and residence time in main storage. The entire process image of the selected candidate is swapped out. in 
some instances the amount of free main storage space required for the process to be swapped in causes the swapping 
out of more than one process; however, using the same selection parameters. This results in greater swapping over- 
head and a less efficient and slower storage management system than the present invention because the present 

35 invention involves location and size when selecting swapout candidates. 

[0005] In the present invention in addition to a list of available memory segments, separate lists of allocated and of 
free memory spaces are provided. The available and allocated circular lists are disjoint lists of segments which together 
account for all of memory. These lists are ordered by size. A third circular list orders all of the segments, both allocated 
and available, by their location in memory This enhances efficiency because segment size and location can now also 

40 be used as parameters when selecting swapout candidates. 

[0006] Additionally, past storage management systems, such as the storage management system of System V type 
operating systems, did not have a data structure which embraced capabilities of the present invention such as segment 
splitting. The present invention improves the efficiency and speed of the storage management system by providing the 
segment splitting capability. Without the segment splitting capability, prior storage management systems had to swap 

45 out enough contiguous segments from main storage which would make room for the total size of the segment to be 
swapped in. 

[0007] The shared image data structure of the preserrt invention enables main storage management to perform its 
function for microprocessing which was also lacking in prior storage management systems. 

[0008] The present invention is an improvement over such past storage management systems in that it selects the 
so least number of the most inefficient processes as candidates for swapout. Additionally, the present invention provides 
for the swapping of a subset of tiie total process image, i.e. partial swapping. Partial swapping allows the mixing of 
pieces of very large processes in main storage with smaller processes. This is accomplished without causing undue 
system overhead such as in the past when large processes were completely swapped out. These improvements pro- 
vide a more efficient and faster main memory management system. 

55 

SUMMARY OF THE INVENTION 

[0009] The principal objective of the present invention is to provide an improved main memory management system 
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for computer systems, and more particularly for non-virtual computer systems which supports multiprogramming and 
can include multiple tightly coupled processors sharing a common main storage, and still more particularly to provide 
an Improved main storage management system for such computer systems which is more efficient and faster. 
[0010] These objects are achieved by incorporating process swapping into the main storage management system 
5 where the swapout candidates are selected according to the least number of the most inefficient processes and where 
a subset of a total process image can be selected for swapout. 

[001 1] New data structures are provided so that the main memory management system can perform improved swap- 
ping. These new data structures in the present invention take the form of lists and tables. One table, the segment table, 
is made up of segment entries which contain fields and flags which indicate logical boundaries, physical addresses, 

10 segment splits, and fields indicating if a segment is resident in memory, on a swap device, or both. One circular list, 
savail. orders available memory segments by size. Another circular list, sactive. orders allocated memory segments by 
size. Still another circular list, sloe, orders both available and allocated memory segments by location. The savail, sac- 
tive. and sloe lists are threads through the segment table entries. One table, the shared image process table, contains 
fields and flags which indicate the status of process images. 

15 [0012] In the preferred embodiment, i.e. non-virtual computer systems which support multiprogramming and can 
include multiple tightly coupled processors sharing a common main storage, each processor at a minimum has one set 
and preferably more, of data control registers which are used by the memory management system to map segment 
splits thereby enabling a user process to view a split segment as being contiguous, i.e. unsplit. By doing segment split- 
ting and segment coalescing, available memory space can be used without reconfiguring memory, i.e. using main 

20 memory as it is currently allocated. When split segments are swapped out of main memory, they are re-united or coa- 
lesced on the swap device to allow the segment to be split Into unique fragments to again fit the current memory con- 
figuration at the time of the next swapin. 

[001 3] Also, tables contain a flag used to facilitate partial swapping. This flag indicates if a segment of a process Is In 
main memory or has been swapped out. By this arrangement, if a process to be swapped in can fit in a segment of a 

25 process which is a candidate to be swapped out, then it is only necessary to swap out the segment rather than the entire 
process which has been done in the past. Partial swapping can also accommodate a segment which needs additional 
memory space in order to grow beyond adjacent free space. Partial swapping to allow growth may be more efficient 
than the past method of memory to memory segment copy depending on the difference between memory-to-memory 
and memory-to-swap-device transfer rates of the hardware the memory management system is being used on. 

30 [0014] When a process has some segments in main memory and some of its segments are on the swap device, the 
segments already in main memory are dual image segments. Therefore, when that process is being swapped In, only 
the segments which are not already in main memory are swapped in rather than the entire process image. Dual images 
of a process's segments are kept as long as possible so as to reduce the amount of memory allocation and physical I/O 
required to move an entire process image into main memory. 

35 [001 5] Although in the present invention main memory management is implemented in a computer system of the type 
described In the above referenced patent applications, it is not limited to this Implementation. The method of the present 
Invention can be implemented in other functions and utilities that require a main memory management scheme for a 
non-virtual or high speed, highly parallel, multiprocessor computer system. 

[001 6] These and other objectives of the present invention will become apparent with reference to the drawings, the 
40 detailed descriptions of the pretended embodiment and the appended claims. 

DESCRIPTION OF THE TERMS 

[0017] 

45 

Coalescing of memory is the process by which fragmented data segments are merged into one contiguous space 
when they are swapped out. 

Data; control register sets are hardware registers used to map fragmented data segments so that the user sees 
one contiguous segment. 

so Dual images are processes which have both reserved main memory and a swap image at the same time. 
Fork is a standard UNIX system call invoked by a parent process in order to create a new child process. 
Microprocesses [mprocs) are a type of lightweight process that have a very low context switch overhead, are dis- 
cardable upon exit, are reusable prior to disposal, provide a means for dividing up work to be done into very small 
segments, and return only the result of the work with no other context Information. 

55 Partial swapping allows a portion of a large process to be swapped out for another process that is to be swapped 
in or in order to grow beyond adjacent free memory. 

Process image is the representation of the process resources within the operating system, such as context infor- 
mation, executable code, and data for a process. 



3 



BNSDOCID: <EP ^0969380A2_I_> 



EP 0 969 380 A2 

Process table contains control and status information needed by the kernel about each process in the system. 
Sactive is a dummy segment structure which heads a circular doubly linked list of allocated segment entries 
ordered by size. 

Savail is a dummy segment structure which heads a circular doubly linked list of available segment entries ordered 
5 • by size. 

Segment table is made up of segment entries which describe attributes of sections of memory which they govern, 
such as whether they contain text or data, whether they are shared or private, whether they are split or unsplit, and 
where the data of each segment is located in memory and/or on a swap device. 

Segments are contiguous parts of a process image which are required to be In main memory during the process's 
10 execution. 

Stiared image is a single process image possibly shared by multiple microprocesses executing multiple threads of 
a multithreaded program. 

Stiared image process table Is made up of entries which contain information about a process image and about seg- 
ments belonging to that image. If the image is not shared, it Is a single process's image. If microprocesses are shar- 
15 ing the image, this entry contains information related to those microprocesses. 

Shared memory is a type of data segment which can be split, written to, and shared by more than one process, 
allowing direct communication between the sharing processes. 

Sloe is a dummy segment structure which heads a circular doubly linked list of allocated and available segment 
entries ordered by location. 

20 Split is a fragment of a segment which resides in main memory and is described by a segment table entry. 

Swap device is an area in an alternate memory used to tenporarily hold a process image not cun'ently running in 
Older to free main memory for a process about to run. The swap device is commonly a block device in a conf igura- 
isle section of a disk. 

Swapping is the act of allocating segments and moving the data in the segments between main memory and a 
25 swap device. 

DESCRIPTION OF THE DRAWINGS 

[0018] 

30 

Rgure 1 is a schematic block diagram of a single multiprocessor cluster system incorporating the present invention. 
Figures 2a and 2b are a dagram illustrating the software architecture for the multiprocessor system of Figure 1 . 
Figure 3 is a block diagram illustrating the swapin and swapout functions. 
Figure 4 is a block diagram of relevant fields in the segment table. 
35 Rgure 5 is a diagram illustrating memory layout lists. 

Rgure 6 is a block diagram of rdevant fields in the shared image process table. 

Rgure 7 is a diagram illustrating the relationship between process table entries, shared image process table 
entries, shared memory segments, and spilt segments. 
Rgure 8 is a diagram illustrating the dual image concept. 
40 Rgure 9 is a diagram illustrating the splitting of a data segment 

Rgure 1 0 is a diagram illustrating memory layout as pertains to choosing a swapout candidate. 
Rgure 1 1 is a diagram illustrating the coalescing of a segment. 

Rgure 1 2 is a diagram illustrating the standard non-virtual UNIX method of creating a child process via the swapout 
procedure when enough main memory is not available. 

45 

DESCRIPTION O F THE: PREFERRED EMBODIMENT 
MEMORY MANAGEMENT 

so [001 9] With reference to the drawings and particulariy to Figure 1 . the present invention by way of example is illus- 
trated as being incorporated in a single multiprocessor duster system having an operating system kernel 11 00 resident 
in main memory 14. Rgure 1 is substantially the same as Figure 5 of the previously filed parent patent application enti- 
tled INTEGRATED SOFTWARE ARCHITECTURE FOR A HIGHLY PARALLEL MULTIPROCESSOR SYSTEM, United 
States Serial No. 07/537,466. filed on June 11. 1990. 

55 [0020] Rgures 2a and 2b illustrate the operating system kernel 1 100 which includes a memory scheduler or main 
memory management system 11 20. Figures 2a and 2b are substantially the same as Figures 8a and 8b of the afore- 
mentioned referenced patent application. The main memory management system 1120 functions to allocate storage 
space in main memory 1 4 for processes to be run and de-allocate storage space in main memory 1 4 from those proc- 
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esses which have run and are in a wait state. Main memory 14 has a finite amount of storage space and normally there 
are more processes in the system than can be stored in main memory 14. Memory management 1 120 is responsible 
for finding or making main memory 1 4 space available to the process which is to be currently run by the computer sys- 
tem. A process image is a representation of the process resources within the operating system, such as code, data, 

5 stack, context Information, and registers. This process image Is separated into a multiple number of segments of type 
text, data, shared memory, library text, library data, or user. If space for this process image is unavailable in main mem- 
ory 14, the memory manager 1 120, Figure 3. can swapout an entire process image, multiple process images, or a sub- 
set of the segments within a process image and place it on a mass storage device such as an alternate memory, a disk 
storage system, or other suitable storage device which is termed a swap device such as swap device 70. The process 

10 Image to be run is residing on swap device 70 and it Is swapped into main memory 14. That process will then be exe- 
cuted by a processor 10 either running to completion or going into a wait state due to some condition such as waiting 
for an input/output, I/O. device. While in this wait state the process becomes a candidate for swapout. 
[0021] The memory manager 1 120 in the preferred embodiment of the invention uses the segment table 90, of which 
a partial entry is shown in Figure 4, to keep track of segments belonging to processes in the system. Fields which are 

15 discussed herein and which are most relevant to the functioning of the memory manager are included in the diagram. 
A segment table 90 entry is created and maintained by the memory manager 1 120 for each segment and each seg- 
ment split belonging to a process which is in the system. 

[0022] The memory manager 1 120 in the preferred embodimerit of the invention uses the three circular doubly linked 
lists in Figure 5 to keep track of space in main memory 14. The-sloc 20 list orders all main memory 14 segments, 

20 whether free 50 or allocated 60, by location. Sloe 20 uses pointers kept in each segment table 90 entry (s bloc is the 
forward link, s bloc is the backward link) to link all segments. The savait 30 list orders main memory 14 segments which 
are free 50, or available for allocation. The sactive 40 list orders main memory 14 segments which are currently active 
60, or unallocatable. Both the sactive 40 and the savall 30 lists are ordered by segment size. Both sactive 40 and savail 
30 uses pointers kept in each segment table 90 entry {s_fsz is the forward link, s bsz is the backward link) to link seg- 

25 ments. Entries in savail 30 and sactive 40 are mutually exclusive, as are use of the segment table 90 pointers sfsz and 
s bsz. The sum of the entries in savail 30 and sactive 40 equal the entries in sloe 20. The memory manager 1 120 
updates these lists to reflect the current memory 14 configuration each time memory 14 is reconfigured due to proc- 
esses growing or entering or exiting the system. The memory manager 1 120 uses these lists,for allocation and freeing 
of main memory 14. 

30 [0023] The memory manager 1 1 20 in the preferred embodiment of the Invention uses the stiared image process table 
190. of which a partial entry is shown in Rgure 6, to keep track of which processes are using each segment, whether 
segment splitting is possible, and information related to swapout candidates. Fields which are discussed herein and 
which are most relevant to the functioning of the memory manager 1 120 are included in the diagram. A shared image 
process table 190 entry exists for every process image in the system. Although the memory manager 1 120 maintains 

35 a number of fields in the shared image process table 190, the remaining fields are maintained and utilized by other 
parts of the operating system kernel 1 100. 

[0024] The relationship between the process table 1 80 entries, shared image process table 1 90 entries, and segment 
table 90 entries are shown in Figure 7. In this example, process table 180 entries 1 and 2 are actually mlcroprocesses 
sharing text 1 and the split data 1 . Mlcroprocesses are thoroughly described in the referenced commonly assigned co- 

40 pending patent application entitled Dual Level Scheduling of Processes to Multiple Parallel Regions of a Multithreaded 
Program on a Tightly Coupled Multiprocessor Computer System, Serial No. 07/xxx.xxx. Process table 180 entry 3 is a 
process which is sharing text 1 with mlcroprocesses 1 and 2. Their shared image process table 190 entries are linked 
via the shared text link {sz shtx link) to indicate this. Process table 1 80 entry 3 is sharing data 2 with process table entry 
4. Their shared image process table 1 90 entries are linked via the shared data link {sishmm link) to indicate this. Proc- 

45 ess table 180 entry 5 represents a process that is not sharing any segments in its image. 

[0025] The following functional description of the memory manager 1 120 relates directly to the memory management 
pseudo-code provided in Appendix A. The functional description references the uses of the tables and fields within the 
tables previously mentioned. 

[0026] As in standard UNIX, as part of the operating system kernel 1100 initialization, the sched process (often 
so referred to as swapper), is initiated to allocate main memory 14 to all processes which are ready to execute, but whose 
process images reside on the swap device 70 and are not yet loaded in main memory 14. When there are no process 
images on the swap device 70 which are ready to execute, the memory manager 1 120 is put in a sleep state which sus- 
pends its execution until the operating system kernel 1100 resumes its execution both periodically and when memory 
allocation is needed. Sched loops through the process table 180 entries Rgure 7, searching for the most eligible proc- 
55 ess which is in the "ready to run" state, but is not loaded in main memory 14. Commonly, most eligible is defined as the 
oldest process which is waiting only for main memory 14, some implementations also use priority as a criteria for most 
eligible; alternately, most eligible can take on any definition as long as no stipulations (except for the allocation of main 
memory 14) prevent immediate execution. Regardless of the definition of eligibility, fields in the process table 180, such 
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as "base level user priority" and "recent processor usage", are used to define which process is the most eligible. 
[0027] In order for a process to execute, its entire process image must reside in main memory 14. Each segment 
belonging to a process image is described in a segment table 90 entry. Each segment table 90 entry contains an s size 
field which indicates the amount of main memory 14 required for that segment. If the required space in main memory 

5 14 is obtained for all segments of this process image, these segments are copied from the swap device 70 to main 
memory 14. that is, swapped in. This mechanism is accomplished by a routine called sWapin, which will be explained 
hereafter. If enough space in main memory 14 for all segments is not obtainable, the memory space which was 
obtained is freed and allocation is attempted again. This allows split segments to be coalesced, then resplit in a new 
way, possibly fitting in the fi^ee space 50. Figure 5 (splitting and coalescing are described In more detail hereafter). If 

10 memory allocation is still not possible, sched will put itself in the sleep state. The dock routine will wake sched at the 
next major clock tick at which time sched will then retry the sWapin, This delay provides a chance for main memory 14 
to reconfigure before allocation is attempted again. Reconfiguration of a shared main memory 14 may occur during this 
delay due to the movement of processes In memory 14 which are running on other processors. If sWapIn still fails to 
allocate space in memory 14, space in main memory 14 is forcibly reconfigured before swapIn is attempted again. 

IS [0028] Forcible reconfiguration is achieved by swapping out the non-running process images residing sequentially in 
memory 1 4 until enough main memory 1 4 is freed for all of the eligible process image segments; that is, as a last resort, 
the first swappable segment on the sloe 20 list is swapped out to force a memory reconfiguration. If the swapin suc- 
ceeds, the next most eligible candidate to be swapped in is selected from the process table 180 for main mennory allo- 
cation. If swapin was still unsuccessful, sched is yet again put in the sleep state until the next major clock tick, to allow 

20 memory 14 to reconfigure. This loop continues until all swapped runnable processes are swapped in. It should be noted 
that sched looping through the process table 180 occurs as in standard UNIX, but the method of acquiring space in 
main memory 14 is unique to the present invention. 

SWAPIN 

25 

[0029] Swapin is the procedure called from sched which finds allocatable or free main memory space 50 for each 
segment belonging to a process image. Although the swapin concept exists in standard UNIX, the implementation 
thereof described here is unique to the present invention. Swapin determines main memory 14 layout by using the sloe 
20, savail 30. and sactive 40 lists. For each segment in a process image, swapin begins by checking if the segment 
30 already exists in main memory 1 4; this is indicated by the segment table field sjlags containing a value of SG LOAD. 
Figure 4. 

[0030] Rgure 8 shows one such situation referred to as dual images, where segments of a process image exist (are 
stored) in main memory 14 while also existing (being stored) on the swap device 70. Dual images result when swapin 
fails to acquire enough main memory 1 4 for all of a process image's segments. The process retains the space in mem- 

35 ory 1 4 it did obtain for the process image's segments in the hope of finishing the memory allocation on the next attempt 
for it to be swapped in. Until this process does acquire enough main memory 14 for all of its segments, it is defined to 
be a process with a dual image. It is only when enough space in main memory 14 is obtained and all of a process 
image's segments are copied into main memory 1 4 from the swap device 70. that the swap image is freed. Dual images 
are prime candidates for swapout, since their space in memory 14 need only be freed, not copied, because the swap 

40 images have not yet been cleared from the swap device 70. 

[0031] Partial swapping would also create a situation where swapin would encounter some segments of a process In 
main memory 14 and other segments not In memory 14. Partial swapping is the process whereby only a subset of the 
total number of segments of a process image have been swapped out Partial swapping can be done to allow another 
process's segments to be swapped in. Partial swapping can also be done if a single segment of a process is swapped 

45 out in order to grow. Swapping out to allow growth is a standard real memory (i.e. non-paged) method off growing a seg- 
ment in memory 14 when it cannot be grown in place. That is, if space in memory 14 following 

this segment is already allocated (i.e. allocated memory 60, Figure 5) and is therefore not available for this segment's 
growth, then the segment is swapped out. its size adjusted to include the desired growth, and it is swapped back in at 
its new size in a free memory space 50 that is large enough to contain it. Some memory management systems accom- 
so plish this growth by moving the segment to a larger area of free memory space 50. but in the present invention, it is 
more efficient to swap the segment rather than do a memory 14 to memory 14 copy, due to the particular hardware plat- 
form having a block transfer rate which is faster than the word to word memory transfer rate. 

[0032] Regardless of whether the situation was created by the existence of dual images or from a partial swap, if the 
segment data to be swapped in already exists in main memory 14. no further allocation processing is required for it. If 
55 the segment to be swapped in does not have allocated space in main memory 14, a single memory block of sufficient 
size to hold the entire segment is sought by scanning the savail 30 list. If a single free space 50 in memory 1 4 of at least 
the proper size does not exist, segment splitting is considered. 

[0033] Segment splitting can be accomplished if the segment to be swapped in is splittable and if the processor 10 
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where this process will execute has unused data control register sets 80, Figure 9. Data control registers are thoroughly 
described in the referenced commonly assigned pending patent application entitled Global Registers for a Multiproces- 
sor System, Serial No. 07/536,198. Commonly, only data segments are defined to be splittable, but the implementation 
of the preferred embodiment accepts any alternate definition. The data control register sets 80 are entities of the hard- 

5 ware system, belonging to each processor 1 0. Each data control register set 80 consists of three control registers (the 
DSEGxS, the DSEGxE, and the DSEGxD registers, where x is between O and the maximum number of data segments) 
used to map logical to physical addresses. Each data control register set 80 records the lower bound (logical starting 
address) 100, the upper bound (logical ending address) 110 and the displacement 1 15 which must be added to the log- 
ical address to obtain the physical address 120. The lower bound 100. upper bound 110. and actual physical starting 

10 address 1 20. are recorded in the segment table 90 entries In fields named s /ft s ub, and s base, as listed In Figure 4. 
The data control register sets 80 map the splits to enable the user to interpret the fragments of the segment as a con- 
tiguous segment. The number of data control register sets 80 per processor 10 determines the maximum number of 
splits per process image. That is. for each split there must be a set of registers to map a user*s logical address to its 
physical location. A field in the shared image process table 190 Rgure 6 entry (si data avail), keeps track of how many 

15 data control register sets 80 remain unused and can therefore be used to map splits. If it is determined that the current 
segment can be split, the largest piece of free memory 50 Is reserved and the bounds thereof and displacement are 
entered in one of the data control register sets 80 to describe split. The SG SPLIT value is entered in the segment table 
90 entry sflags fieki to indicate that this is a split segment. The upper bound 100, lower bound 110, and physical 
address 120 description are saved in the segment table 90 entry for this split (fields s ub, s lb, s base). The segment 

20 table 90 entry for this split Is also updated to include links to the previous and next split of this segment (fields s prvsplt 
and s nxtsplf). The shared image process table 190 entry is adjusted to hold the current count off remaining splits avail- 
able (field si data avail)- As long as unused data control register sets 80 for this processor 10 remain and the segment 
to be swapped In is not completely in memory 14. this splitting process continues. 

[0034] In the case that there is no free memory space 50 for the current nonsplittable segment, intelligent choices are 
25 made about how to create free space 50. The six choices for swapout candidates follow in order of priority. First, seg- 
ments belonging to shared process images that already have some of their segments moved to the swap device 70 are 
swapped out. This includes dual image segments and partially swapped images. Second, segments belonging to sleep- 
ing processes 150 which with adjacent free space 50 are of sufficient size for the current segment are swapped out. 
Third, segments belonging to adjacent sleeping processes 150 who together free enough space for the current seg- 
30 ment are swapped out. Fourth, segments belonging to both runnable 160 and sleeping 150 processes who together 
with adjacent free space 50 are of sufficient size for the current segment are swapped out. Fifth, segments belonging 
to adjacent runnable 160 and sleeping 150 candidates who together free enough space for the current region are 
swapped out. Finally, as a last resort, shared memory segments are swapped out. Figure 10 illustrates a main memory 
layout, including free space 50, swapout candidates 150 and 160, and non-candidates 170 for the swapout procedure 
35 previously described. That is, all of the segments under the heavy arrow in the diagram could be swapped out if neces- 
sary to free enough main memory 14 space for an incoming segment. 

[0035] When memory is allocated for a segment by the swapin procedure, the value SG JUST IN is set in the sflags 
field of the segment table entry 90 Figure 4 to keep track of which segments need physical copying. That is, segments 
already containing data do not need to be copied in from the swap device 70; their sflags field indicates this by contain- 
40 ing the value SG LOAD. This situation occurs when a process Is a dual image or is partially swapped out. For example, 
if only the data segment of a process was swapped out. then only that data segment is copied back to memory 1 4 from 
the swap device 70. The count of allocated (in-memory) segments in the shared imsge process table 190 Rgure 6 entry 
field si segs in is also incremented at this time. 

[0036] When the count of allocated segments is equal to the total number of segments for this process image, space 
45 in memory 14 has been allocated for the entire image so segments on the swap device can be copied into memory 14. 
The segments are sequentially processed. This processing includes locking the segment table entry to make it inac- 
cessible by other processes, physically copying the data of size s size contained in the segment from the swap device 
70 at the address saved in the segment table 90 entry field s swapaddr 70 to main memory 14 at the address saved in 
the segment table 90 entry field s base, and setting the value SG LOAD In the sflags 
so field of the segment table 90 entry (Indicating memory 14 now contains the segment data). 

[0037] If any of the segments just swapped in are shared memory segments (those being shared between more than 
one process) each shared image process table 190 entry is updated. This includes updating reference counts and 
marking that process image as loaded if all segments for that process image are now in memory 14. 
[0038] At the successful completion of memory allocation for the current process, it Is able to execute. Sched then 
55 continues searching the process table 180 for another L eligible process to swapin, continuing the loop described ear- 
lier. 
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SWAPOUT 

[0039] Out seg is the procedure called during swapin which creates free space 50 in main memory 1 4 by moving data 
in a segment from memory 14 to a swap device 70. The particular segments to be swapped out are determined as pre- 
5 viously described. 

[0040] Initially, the segment table entry of the segment whose contents are to be swapped out is locked to make it 
inaccessible by other processes. 

[0041] If the entries in the segment table 90 Figure 4 indicate that this segment has been split into more than one 
piece [sflags contains the value SG SPLIT), then those splits are re-united or coalesced. Coalescing, which implies that 
10 contiguous space is allocated on the swap device 70 for all splits and the contents of the splits are merged into this area 
when written from memory 1 4, is shown in Figure 1 1 . 

[0042] The segment, split or unsplit, of size s ska is physically copied from main memory 14 at the address saved in 
the segment table 90 entry field s base to the swap device 70 at the address saved in the segment table 90 entry field 
s swapaddr 70. Then, depending on exact circumstances, flags are updated to reflect the swapout status. The shared 

15 image process table 190 entry reference count (sisegs in), that is the count of the number of segments in memory 14, 
is decremented for each image sharing this segment. The shared image process table 190 entry field si data avail is 
37 adjusted to reflect the coalescing of the splits. The values SG SPLIT, SG JUST IN, and SG LOAD are cleared from 
the segment table entry field sflags to indicate that it is no longer split, memory is no longer reserved for it, and data for 
it is no longer contained in main memory 1 4. The data control register sets 80 describing this segment are also cleared. 

20 [0043] If swapout is being called as the result of a fork (indicating a parent process image is being copied to the swap 
device 70 without destroying the parent process image to create a new child process image), main memory 14 for this 
segment is not freed. In all other cases, space in main memory 14 for the swapped out segments of a process is freed. 
In the case of a fork, the child process image on the swap device 70 will be swapped in later when the child process is 
eligible to execute. This standard real memory (non-paged) creation method, is illustrated in Figure 12. 
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Appendix A 
MEMORY MANAGEMENT PSEUDO-CODE 

1.0 schedO 

/ * Procedure: schedO 
♦ Purpose: Swap in all eligible images. 
V 

schedO 

( 

loop: 

for ( each proc table entry ) 
choose oldest eligible 
20 if ( none eligible ) 

sleep 
unload: 
attempt to swap image in 
if ( cannot swap in ) { 
swap back out / * coalesce*/ 

attempt to swap in again /* now can resplit*/ 

if ( successful ) 

go to loop /* choose next process to swap in*/ 

else 

if ( process has only been out short while ) 
35 delay one second 

go to unload /* try to bring in again*/ 

else 

swap out first candidate on allocated list 
attempt to swap in again 
if ( successful ) 

go to loop /* choose next process to swap in */ 

45 delay one second /* caimot bring in^delay &*/ 

go to loop /* choose next process to swap in*/ 

) else 

go to loop /* choose next process to swap in*/ 

) /*sched V 
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2.0 swapin 

/ » Procedure: swapinQ 
* Purpose: Swap in all segments of sp>edfied shared image. 



swapin ( si_ptr ) 
{ 

/* allocate memory for all segments of image */ 
for ( each segment in image ) { 

if ( already has memory ) 

use it 

else { 

find memory for segment 
if ( could not find memory ) 

retry^ forcing out shared texts 
if ( memory foimd ) 

set SG JUST_IN in segment flags 

for ( all images sharing this segment ) 
adjust count of segments alloc'd 

1 

1 

if ( all segments successfully alloc'd memory ) ( 
for ( each segment in image ) { 
lock the segment for swapping 
/•do physio */ 
if ( segment is not loaded ) { 
swap in valid blocks 



/* in^segO*/ 

/♦ in.segOV 

/* did not already*/ 
/* have memory*/ 

/* si_segsjn*/ 



/* swaplockO*/ 



1 / 



set SG^LOAD in segment flags 
if ( swap image exists ) 
free swap space 

1 

/* lock n6t released until next loop, hold tmtil */ 

/* after reference counts are adjusted*/ 

* for - adjust reference counts and possibly set SLOAD */ 



/•invalid blocks if growing*/ 
/•or creating segment*/ 
/* physio is done */ 
/* won*t if creating */ 
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for ( each segment in image ) { 
if ( SGJUST^IN ) ( 
for ( each sharing image ) ( 

if ( segment counts indicate all segments in ) 
if ( none of segments in are dual images ) 

set SLOAD/* physio need be done for duals */ 
update swap and memory reference counts 

) 

set off SG JUST.IN 
) 

release swap lock /* swapreleO */ 

} /*forV 
) else 

return failure 
) /• swapin */ 
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3.0 swapout 



/ ♦ Procedure: swapout 
* Purpose: Swap out all segments in specified image. 
V 

swapout ( si_ptr ) 
{ 

for ( each segment in image ) { 
swap out segment /* out^segO*/ 

) 

if ( swapped out to create child on swap device ){ 
put child on runq 
wake parent 

} 

1 / * swap>out */ 



4.0 in seg 

/ • Procediu^ie: in_seg 

• Purpose: Rnd memory for specified segment. Possible force 

• out other segments to do so. */ 
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in.seg ( seg^ptr, seg^type, si_ptr ) 
I 

attempt to malloc 

/* no free entry of sijffident size exists, try splitting if possible */ 

if ( failed and this is a splittable segment ) /* data or shmem •/ 

if ( shared memory segment ) 

find minimum of control registers available to all sharing 
while ( failed and control registers and memory available ) ( 
malloc largest available chunk /♦ free->tail*/ 

if ( successful ) { 

decrement register counts for all sharing images 
record split in segment table 
set on SG.SPUT segment flag 
attempt to malloc remainder 

) 
} 

1 

if ( faUed ) { 

swap out segments of shared images that have some segments already 
out attempt to malloc incoming segment again 

) 

if ( faUed ) { 

swap out sleeping candidates who with adjacent free space are of 

sufficient size for incoming segment 
attempt to malloc incoming segment again 

) 

if{faUed}{ 

swap out adjacent sleeping candidates who together free enough 

space for incoming segment 
attempt to malloc incoming segment again 

) 

if (faUed)( 

swap out nmnable /sleeping candidates who with adjacent free 

space are of sufficient size for incoming segment 
attempt to malloc incoming segment again 

) 

if ( faUed ) ( 
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swap out adjacent runnable/sleeping candidates who together 

free enough space for incoming segment 
attempt to malloc incoming segment again 

1 

) / ♦ in_seg */ 

5.0 out.segO 

/ • Procedure: out segO 
* Purpose: Swap out specified segment, 
*/ 

out_seg ( segment, si^ptr ) 
{ 

lock for swapping 

if ( swappable SG^SPUT segment ) I 
if ( segment is SG^LOADED ) { 
/* all splits must be in, coalesce on swap device */ 
alloc swap space large enough for all splits 
set off SG^LOAD segment flag 
for ( each image sharing this segment ) { 

adjust reference counts 

setoffSLOAD 

) 

for ( each split ) { 

copy to swap device 
/* fork => child being created on swap device, do not 
/* free parent's memory 
if ( not forking ) 
free memory 

for ( each image sharing this segment ) 
adjust segment counts 

) 

set off SG^SPLTT 
) else ( 

/* physio not done => dual isegmcnt or all splits not alloc'd 
for { each split ) ( 
free memory 



/* swaplockO*/ 
/* physio done*/ 



/♦do physio*/ 



•/ 



V 
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for ( each image sharing this segment ) 
adjust segment counts 

) 

set off SG.SPUT 
set off SG JUST^IN 



1 

) else if ( swappable SG^LOAD'd segment ) { 
set off SG^LOAD 

for ( each image sharing this segment ) { 
adjust reference counts 
adjust segment counts 
set off SLOAD 

) 

if ( segment is being created ) / 

adjust segment counts 
else { 

if ( swap image exists ) 

use it 

else 

alloc swap space 
copy to swap space 

/* fork -> child being created on swap device, 
/* do not /* free parent's memory 
if ( not forking ) 
free memory 

) 

) else { 



/* may not have been on*/ 
/* swapin must realloc*/ 

/* not split*/ 



segment's r _nvailid 0*/ 
/* need not alloc swap*/ 



/* do physio*/ 
V 
V 



/* not SG LOAD'd or not swappable (still shared) */ 



if ( not SG^LOAD but has memory ) { 
free memory 

for ( each image sharing this segment ) 
update segment counts 
set off SGJ[UST_.IN 

) 

/* else => still shared, do nothing */ 
) 

release swap lock 
1 /* out^seg */ 



/* dual segment*/ 



/* swapin must realloc*/ 



/* swapreleQ*/ 
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6.0 ifi candO 

/ * Procedure: is candO 

♦ Purpose: Determine if specified memory is a sleeping swap out 

candidate. 

V 

is_candr ( memory node, si_ptr ) 
I 

if ( segment is SG^OCK'd ) 

return failure 
if ( segment is process O's kseg area ) 

return failure 

if ( shared segment and not being forced out )/* r_refcnt, FORCE_OUT*/ 

return failure 
for ( each image sharing this segment ) { 
if ( ( image is being swapped out ) or 
( all processes sharing image are not sleeping ) ) 

return failure 
if ( ( any process sharing image is a system process ) or 
( image is locked in memory ) ) 
return failure 

1 

) /* is.cand •/ 
7.0 is candrO 

/ ♦ Procedure: is_candr() 

♦ Purpose: Determine if specified memory is a 

♦ runnable/sleeping swap out candidate. 
V 

is_candr( memory node, si.ptr ) 
( 

if ( segment is SG.LOCK'd ) 

return failure 
if ( segment is process 0*s kseg area ) 

return failure 
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if ( shared segment and not being forced out > /* r retcnt, FORCE OUT*/ 

return failure 
for ( each image sharing this segment ) { 

if ( ( image is being swapped out ) or ( image has 
microtasks ) or 

( any process sharing is currently running ) ) 

return failure 
if ( any process sharing image is a system process^ is 
locked in memory, or is runnable but has not been out 
long enough ) 
return failure 

) 

) /* is_candr */ 



[0044] Although the description of the preferred embodiment has been presented, it is contemplated that various 
25 changes could be made without deviating from the spirit of the present invention. Accordingly, it is intended that the 
scope of the present invention be dictated by the appended claims rather than by the description of the preferred 
embodiment. 

Claims 

30 

1. An improved dual image allocation method for operating non-virtual main memory manager (11 20) using swapin 
and swapout operations to allocate and un-allocate space in a non-virtual main memory (14) for one or more seg- 
ments of one or more process images residing on a swap device (70) and ready to be executed in a computer 
processing system that includes one or more processors sharing the main memory and the swap device wherein 

35 the segments require space of varying sizes and all of the segments for a process image must be resident in the 
main memory (1 4) before the process image can be executed by the computer processing system, the steps of the 
improved method comprising: 

performing a swapin allocation operation to allocate contiguous space in the main memory to at least one seg- 
40 ment of one process image residing on the swap device, 

the swapin allocation operation including the step of checking to determine if the one segment already has 
been allocated space In the main memory. 

If so. performing another swapin allocation operation to allocate contiguous space in the main memory (1 4) to 
another segment of the one process image, 

45 if not, checking for un-allocated contiguous space in the main memory large enough to store the entire one 

segment, and allocating that space to the one segment and copying the segment to the main memory (14), 
in the event that space is allocated to the one segment, retaining an image of the segment on the swap device 
so as to create a dual image allocation whereby it is only necessary to un-allocate the space allocated to the 
one segment, without copying the segment to the swap device (70) in the event the segment is to be removed 

50 from main memory by a swapout operation. 

2. The improved method of claim 1 further comprising the step of: 

retaining allocated space in the main memory (14) for some segments of a process image until all segments 
55 of that proems image have been allocated space in the main memory. 

3. The improved method of claim 2 further conprising the step of: 
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freeing a process image from the swap device (70) in the evert that all segments of that process image have 
been allocated space in the main memory (14). 

4 An improved dual allocation swapout method for operating a non-virtual main memory manager (1120) using 
5 swapin and swapout operations to allocate and un-allocate space in non-virtual main memory (14) for one or more 

segments of one or more process images residing on a swap device and ready to be executed in a computer 
processing system that includes one or more processors sharing the main memory and the swap device (70) and 
wherein the segments require space of varying sizes and all of the segments for a process image must be resident 
in the main memory (14) before the process image can be executed by the computer processing system, and 
10 wherein the main memory manager performs a swapin operation for the segments of a selected process image 
ready to execute and performs a swapout operation tor the segments of one or more process images currently 
stored in the main memory (14), the steps off the improved method comprising: 

determining if a segment to be swapped out of the main memory has a dual allocation in the main memory (14) 
IS and on the swap device (70), . 

in the event that the segment has a dual allocation in the main memory (14) and on the swap device (70). un- 
allocating space in the main memory allocated for that dual allocation of the segmert without copying the seg- 
ment to the swap device (70) as part of a swapout operation. 

20 5. The improved method of claim 4 further comprising the steps of: 

determining that the segmert to be swapped out does not have a dual allocation in the main memory (14) and 
on the swap device (70), 

allocating a space on the swap device of a sufficient size to cortain the segment. 
25 determining that the segment has been divided into split segments. ^ *u 

In the event that the segmert has been divided irto partial segments, coalescing the split segments irto the 
space allocated on the swap device (70). and 

in the evert that the segment has no split segments, moving the segmert into the space on the swap device 
(70). 

6. The improved method of any one of the preceding claims further comprising: 

as one step in the swapout operation, performing a partial swapout operation by swapping out of the main 
memory (14) less than all of the segments of one process image contained in the main memory (14) m order 
to free allocated space in the main memory (14) to enable the swapin operation to allocate the now un-allo- 
cated space in the main memory (1 4) to one or more segments of another process image. 

7 The improved method of claim 6 wherein the step of performing the partial swapout operation enables one or more 
of the segments that were swapped out to obtain additional space in the main memory (14) in the evert that the 
segmert is swapped in again without swapping out all of the segments of the process image at the time that the 
one or more segments are swapped out. 

8. The improved method of any one of the preceding claims, further comprising: 

determining whether there is un-allocated space (50) in the main memory (14) of sufficient size to cortain a 
segment to be swapped into the main memory (14). 

if there is un-allocated space (50) in the main memory (14) of sufficient size to cortain the segmert to be 
swapped into the main memory (14), then allocating that space to the segment, 

If there is no suffidert un-allocated space (50) in the main memory (14) to cortain the segmert to be swapped 
into the main memory (14). then determining whether the segmert may be divided irto split segments accord- 
ing to a predetermined criteria, and 

if the segmert may be divided into split segments, then splitting the segment into at least two split segments, 
at least one of the split segments being allocated a memory size corresponding to an un-allocated contiguous 
space in the main memory. 

9, The improved method of claim 8 further comprising the step of: 
recording for the segment which has been split into split segmerts a lower bound (100). an upper bound (1 10) 
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and a displacement (1 15) to enable mapping of a logical storage address to its physical location in the main 
memory (14). 

1 0. The improved method of claim 9 wherein the lower bound (1 00), the upper bound (1 1 0) and the displacement (1 1 5) 
5 are recorded in a set of registers (80) in the multiprocessor system. 

11. The improved method of claim 10 wherein the multiprocessor system has a predetermined number of sets of reg- 
isters to enable a predetermined number of segments to be split into split segments and thereby provide mapping 
of a logical storage address to its physical location in the main memory (14) for each split segment. 

10 

12. The improved method of claim 1 1 wherein in the event that a spirt segment is swapped out of the main memory 
(14), the set of registers containing the lower bound (100), the upper bound (110), and the displacement (115) is 
cleared and thereby becomes available for recording the lower bound (100). the upper bound (110) and the dis- 
placement (1 1 5) of another segment which is split into split segments. 

IS 

13. The improved method of claim 12 further comprising the step of: 

coalescing the split segments of the one segment into contiguous space on the swap device. 

20 14. The improved method of any one of the preceding claims, further comprising: 

creating un-allocated space in the main memory (14) by performing a swapout operation on a segment chosen 
by analyzing the segments stored in the main memory (1 4) which are adjacent to any contiguous space in the 
main memory (14) that can be allocated to a segment to be swapped into the main memory (14), 
25 such that a segment will not be swapped out of the main memory (14) unless doing so creates sufficient con- 

tiguous space in the main memory (14) to allocate for the memory size of the segment to be swapped into the 
main memory (14), thereby increasing the efficiency of the main memory manager. 

15. The improved method of claim 14 wherein the segment selected as the focus of the swapout operation to increase 
30 the efficiency of the main memory manager Is a segment having both allocated space in the main memory (1 4) and 

an image of the process associated with the segment on the swap device (70). 

16. The improved method of claim 14 wherein the segment selected as the focus of the swapout operation to increase 
the efficiency of the main memory manager (1 120) is a segment associated with a process image which currently 

35 cannot be executed and which has allocated space in the main memory (14) that is adjacent to un-allocated space 
in the main memory (14) of sufficient size that when the adjacent un-allocated space in the main memory (14) is 
combined with the memory size of the space allocated to the segment to be swapped out the resulting memory size 
is large enough to contain another segment to be swapped into the combined space in the main memory (14). 

40 17. The improved method of claim 14 wherein the segment selected as the focus of the swapout operation to increase 
the efficiency of the main memory manager (1 120) is a segment associated with a process image which currently 
cannot be executed and is adjacent to a second segment associated with another process image which cunrently 
cannot be executed such that when the space in the main memory (14) for the one segment is combined with the 
space in main memory (14) for the second segment, the resulting memory size is large enough to contain a current 

45 segment to be swapped into the combined space in main memory (14). 

18. The improved method of claim 14 wherein the segment selected as the focus of the swapout operation to increase 
the efficiency of the main memory manager (1 120) is a segment associated with either a process image which is 
currently executable or a process image which is not currently executable and is adjacent to un-allocated space In 
so the main memory (1 4) of sufficient size that when the memory size of the space allocated to the segment which is 
the focus of the swapout operation and the adjacent un-allocated space in the main memory (14) are combined, 
the resulting memory size is large enough to contain another segment to be swapped into the combined space in 
the main memory (14). 

55 19. The improved method of claim 14 wherein the segment selected as the focus of the swapout operation to increase 
the efficiency of the main memory manager (1 120) is a segment associated with a process image which currently 
cannot be executed and is adjacent to a second segment associated with a process image which currently can be 
executed such that when the space in the main memory (14) for the one segment is combined with the space in the 
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main memory (1 4) for the second segment, the resulting memory size is large enough to contain a current segment 
to be swapped into the combined space in the main memory (14). 

20. The improved method of any one of the preceding claims, further comprising: 

determining for each segment of the selected swapin process image if space in main memory (14) has or has 
not been allocated for that segment 

in the event that space in the main memory (1 4) has not been allocated for a segment, then determining if suf- 
ficient contiguous space in the main memory can or cannot be aiiocated for that segment, 
in the event that sufficient contiguous space in the main memory (14) cannot be allocated for that segment, 
then attempting to allocate space in the main memory (14) for that segment by allowing segments shared by 
more than one process image to be forced out of the main memory (14). 

21 . The Improved method of claim 20 wherein the step of attempting to allocate space in the main memory (14) com- 
15 prises: 

performing a search of space in main memory (14) to determine if sufficient contiguous un-ailocated space in 
the main memory (14) exists which is of sufficient size to contain that segment. 

20 22. The improved method of claim 20 wherein the step of allocating space in the main memory (14) comprises: 

splitting that segment into split segments, each split segment of a memory size which fits within the cun-ently 
un-allocated spaces in the main memory (14). 

23. The improved method of claim 20 wherein the step of allocating space in the main memory (14) comprises: 

performing a swapout operation on segments in the main memory (14) which are associated with other proc- 
ess images which do not have all segments associated with the process image contained in the main memory 
(14). 

24. The improved miethod of claim 20 wherein the step of allocating space in the main memory (14) comprises: 

performing a swapout operation on segments in the main memory (14) associated with a process image which 
is not currently executable and which are adjacent to un-allocated space in the main memory (14) such that 
35 the memory size of the segments combined with the memory size of the adjacent un-allocated space in the 

main memory (14) is sufficient contiguous space in the main memory (14) to contain that segment which is to 
be swapped into main memory (14). 

25. The improved method of claim 20 wherein the st^ of allocating space in the main memory (14) conr^rises: 

performing a swapout operation on segments in the main memory (14) associated with a process image which 
is not currently executable or associated with a process image which is currently executable and which are 
adjacent to un-allocated space in the main memay (14) such that the memory size of the segments combined 
with the memory size of the adjacent un-allocated space in the main memory (14) is sufficient contiguous 
space in the main memory (14) to contain that segment which is to be swapped into main memory (14). 

26. The improved method of claim 20 wherein the step of allocating space in the main mennory (14) comprises: 

performing a swapout operation on adjacent segments in the main memory (14) associated with other process 
image which is not currently executable and associated with process image which is cun-ently executable and, 
such adjacent segments are adjacent to un-allocated space in the main memory (14) such that the memory 
size of each segment combined with the memory size of the adjacent un-allocated space in the main memory 
(14) is sufficient contiguous space in the main memory (14) to contain that segment which is to be swapped 
into main memory (14). 

55 

27. The improved method of claim 20 wherein the step of allocating space in the main memory (14) comprises: 

first searching space in the main memory (1 4) to determine if any un-allocated space in the main memory (1 4) 
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exists which is large enough to contain that segment, and in the event that sufficient space in the main memory 
(14) to contain that segment is not un-allocated. then 

secondly attempting to split that segment into split segments which fit within currently un-allocated spaces in 
the main memory (1 4) and if the split segments of that segment do not fit within currently un-allocated spaces 
5 in the main memory (1 4), then 

thirdly performing a swapout operation on segments of other process images which have some segments 
already swapped out and if that segment did not fit within then un-allocated spaces in the main memory (14), 
then 

fourthly performing a swapout operation on segments of a process image which is not currently executable 
10 which combined with adjacent un-allocated space in the main memory (14) creates contiguous memory of a 

size to contain that segment and if that segment did not fit within then un-allocated spaces in the main memory 
(14), then 

fifthly performing a swapout operation on segments of a process image which are not currently executable or 
a process image which Is currently executable, these segments combined with un-altocated space in the main 
15 memory (1 4) adjacent to those segments creates contiguous memory of a size to contain that segment which 

is to be swapped into main memory (1 4). 

28. The improved method of any one of the preceding claims, further comprising: 

20 allocating space on the swap device of a size which is large enough to contain a segment of a selected 

swapout segment of a process image, 

determining if the selected swapout segment has been divided into two or more split segments, 
in the event that the selected swapout segment has split segments, coalescing the split segments into the 
space allocated on the swap device, and 
25 in the event that the segment has no split segments, moving the segment into the allocated space on the swap 

device. 

29. The method of any one of the preceding claim, further comprising the steps of: 

30 (a) selecting a swapin process to be swapped into the main merrory (14) from the swap device (70); 

(b) for each segmerrt of the process image of the swapin process, performing the steps of: 

(b1) determining whether the segment has been allocated space in the main memory (14); 
(b2) if the segment has not been allocated space in the main memory (1 4), determining whether there are 
35 any un-allocated contiguous spaces in the main memory; 

(b3) if there are no un-allocated contiguous spaces in the main memory (14), executing a swapout proce- 
dure to create one or more un-ailocated contiguous spaces in the main memory (14); and 
(b4) if there ace at least one un-allocated contiguous space in the main memory (14), attempting to allo- 
cate contiguous space in the main memory (14) for the segment, including the steps of: 

40 

(b41) allocating space to the segment if there is sufficient un-allocated contiguous space in the main 
memory (1 4) for the memory size of the segment, 

(b42) splitting the segment into two or more split segments if there is not sufficient contiguous space 
in the main memory (14) to allocate for the memory size of the segment and if the segment contains 
45 one of a predetermined set of types of information which can be split, such that at least one of the split 

segments is of a memory size that sufficient un-allocated contiguous space in the main memory can 
be allocated to that split segment, and 

(b43) executing the swapout procedure if there is not sufficient un-allocated contiguous space in the 
main memory (14) for the memory size of the segment or one of the split segments and repeating 
50 steps (b41) - (b42); and 

(c) if all of the segment of the swapin process were allocated space in the main memory (14), copying all of the 
segments of the process image from the swap device to the main memory (14) and adding the process to a 
run queue of processes to be executed by one or more of the processors. 

55 

30. The method of claim 29 further comprising in the event that all of the segments for the swapin process were not 
allocated space in the main memory (14) as a result of step (b), performing the steps of: 
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(b5) swapping out all of the segments of the swapin process that were allocated space In the main memory (14) 
to allow any split segments to be coalesced and repeating steps (b2) - (b4); 

(b6) in the event that all of the segments for the swapin process were not allocated space in the main memory 
(14) as a result of step (b5). delaying for a predetermined period of time and repeating step (b5); and 
5 (b7) in the event that all of the segments for the swapin process were not allocated space in the main memory 

(1 4) as a result of step (b6). selecting a new swapin process and repealing step (b). 

31 . The method of claim 29 wherein the swapout operation selects the segments to be swapped out of the main mem- 
ory (14) by analyzing the segments stored in the main memory (14) which are adjacent to any contiguous spaces 

10 in the main memory that can be allocated to the segment of the swapin process, such that a segment will not be 
swapped out of the main memory (14) unless doing so creates sufficient contiguous un-allocated space in the main 
memory ) 14) to allocate for the memory size at least one of the segments or split segments of the swapin process. 

32. The method of claim 31 wherein the swapout operation comprises the steps of: 

(a) unallocating space for the any segments of any process images for which not all of the segments of the 
process image have been allocated spaces in the main memory (14); 

(b) determining if swapping out a process that is sleeping and is adjacent to any unallocated space will create 
sufficient space to allocate to one or more of the segments or split segments of the swapin process and, if so, 
swapping out that process and exiting the swapout operation; 

(c) determining if swapping out adjacent process that are sleeping and are adjacent to any unallocated space 
will create sufficient space to allocate to one or more of the segments or split segments of the swapin process 
and, if so, swapping out those processes and exiting the swapout operation; and 

(d) determining if there is a combination of processes that are sleeping and executing and are adjacent.to any 
unallocated space that will create sufficient space to allocate to one or more of the segments or split segments 
of the swapin process and. if so, swapping out that process and exiting the swapout operation. 

33. The method of any one of the preceding claims, further comprising the steps of: 

during the swapin allocation operation wherein contiguous space in the main memory (14) is allocated to one 
or more of the segments of a process that are to be swapped into the main memory (14) from tiie swap device 
(70), 

attempting to split one or more of the segments of the process into two or more split segments if there is not 
sufficient contiguous space in the main memory (14) to allocate for the memory size of tiie segment and if tiie 
segment contains one of a predetermined set of types of information which can be split, such that at least one 
of the split segments will be of a memory size that sufficient contiguous space in tiie main memory (1 4) can be 
allocated to that split segment; and 

during a swapout operation wherein one or more of the segments of a process are to be swapped out of the 
main memory (1 4) to the swap device (70), 

coalescing any split segments of a segment of the process into the memory size of that segment as the seg- 
ments are transferred to the swap device (70), 

whereby utilization of the main memory is enhanced by splitting the split segments into memory sizes that cor- 
respond to contiguous memory spaces in the main memory (14) that are available each time a swapin alloca- 
tion operation is performed for a process. 

34. The method of any one of the preceding claims, furtiier comprising tiie steps of: 

during a swapout operation wherein one or more of the segments of one or more of the processes are to be 
swapped out of the main memory (14) to tiie swap device , selecting the segments to be swapped out of the 
so main memory (14) by analyzing tiie segments stored in the main memory (14) which are adjacent to any con- 

tiguous space in the main memory ( 1 4) that can be allocated to the segment to be swapped into the main mem- 
o''y ("1^). such that a segment will not be swapped out of the main memory (14) unless doing so creates 
sufficient contiguous space in the main memory (14) to allocate for the memory size of the segment to be 
swapped into the main memory (14). 
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